Dynamic Interactive Voice Interface

ABSTRACT

A dynamic voice user interface system is provided. The dynamic voice user interface system interacts with a user at a first level of formality. The voice user interface system then monitors history of user interaction and adjusts the voice user interface to interact with the user with a second level of formality based on the history of user interaction.

COPYRIGHT & TRADEMARK NOTICE

A portion of the disclosure of this patent document contains material,which is subject to copyright protection. The owner has no objection tothe facsimile reproduction by any one of the patent document or thepatent disclosure, as it appears in the Patent and Trademark Officepatent file or records, but otherwise reserves all copyrightswhatsoever.

Certain marks referenced herein may be common law or registeredtrademarks of third parties affiliated or unaffiliated with theapplicant or the assignee. Use of these marks is by way of example andshall not be construed as descriptive or limit the scope of thisinvention to material associated only with such marks.

BACKGROUND

1. Field of Invention

The present invention relates generally to interactive interfaces and,more particularly, to a dynamic interactive voice interface.

2. Related Art

Voice communication devices, such as telephones, traditionally have beenused for mere voice communications or for accessing information usingtouch-tone dialing. With advancements in communications technology,today various types of information can be accessed using voicerecognition systems that translate spoken utterances into systemcommands for data retrieval. Voice recognition systems, typically,include interactive voice interfaces.

An interactive voice interface (also referred to as voice user interfaceor VUI) is a type of interface that is voice driven. Using particularvoice commands, a person can interact with the voice interface in orderto browse the content of a web site or access information stored in adatabase, for example. A VUI provides the communication means between auser and a voice recognition system. A voice recognition systemrecognizes a user utterance or user request and attempts to service therequest.

Many VUIs are implemented to provide the user with certain prompts orinteractive voice menus to assist the user to communicate with the voicerecognition system. In interacting with the users, many of the currentVUIs are rigid, monotonous, repetitious, and basically inhuman. Inasmuchas spoken discourse is a dynamic process, the current VUIs fail tocapture the essence of natural conversation. Developing personified,natural language VUIs is an art and a science in itself.

Studies have shown that user interaction with technology isfundamentally social. Thus, social rules should desirably be applied tocomputer voices. Designers of current VUIs have not fully addressed thesocial issues revolving human-computer interaction. Therefore, thecurrent VUIs lack the artistic touches that go along with voice acting,voice directing, and audio engineering—factors that should be allconsidered while developing and implementing a VUI. For example, thecurrent VUIs do not have a well-defined human personality that caninteract with a user in a natural conversational style and adapt to theuser needs and environment.

Furthermore, spoken discourse is a collaborative process that changes asthe conversation unfolds based on the shared knowledge of theparticipants. Unfortunately, current VUIs are not implemented toremember past interactions with the user and accordingly modify theirbehavior as expected in natural spoken language. For example, typicallythe conversational style between two people becomes less formal as thetwo people become more intimate during the conversation. But the currentVUIs fail to adapt their conversational style in a natural way. Forexample, a VUI continues to repeat the same prompts over and over again,regardless of the number of times a particular user has interacted withthe system. This can be impersonal, unhelpful, and irritating.

People interact more positively with a person who communicates so as notto offend other people. This behavior is also expected on a consciousand subconscious level with voices associated with computerapplications. Marketing research has shown that providing moreuser-friendly interactive systems provides greater buying intentions andhigher quality reviews. Thus, a voice user interface system is desirablethat can incorporate human personality and provide intelligent responsesthat can assist a user to access needed information. Further, it isdesirable for a VUI. to develop a more human conversational style and toadapt to changes in a user's speech and experience over time.

The following references provide more detailed information on the topicof human computer interactions and computer generated speech:

1. H. H. Clark, Arenas of language use (1992).

2. L. Karttunen & S. Peters, “Conventional Implications of MontagueGrammar,” Berkeley Linguistic Society, 1, 266-278 (1975).

3. D. K. Lewis; Convention: A Philosophical Study (1969).

4. C. Nass & K. M. Lee, In press, “Does computer-generated speechmanifest personality? An experimental test of similarity-attraction andconsistency,” Journal of Experimental Psychology: Applied.

5. C. Nass et al., “Are Respondents Polite to Computers? SocialDesirability and Direct Responses to Computers,” Journal of AppliedSocial Psychology, 29(5), 1093-1110 (1999).

6. B. Reeves & C. Nass, The Media Equation (1996).

7. S. Schiffer, Meaning (1972).

8. R. C. Stalnaker, Assertion. In P. Cole (ed.) Syntax and Semantics,vol. 9. Pragmatics, 315-332 (1978).

SUMMARY

One aspect of the invention is directed to a voice interface system andcorresponding methods that dynamically adapt to interact with a user ina natural conversational style. Embodiments of the system are designedto provide access to voice-mail as well as other information, such asupdates on stock quotes, news, weather, and sports scores.

In some embodiments, the voice interface system is designed to establishand maintain a relationship between a user and a consistent voicepersonality in order to provide a friendly and natural conversationalambiance. For example, in some embodiments the user and the VUI interactor converse in a less formal manner as the user history of interactionwith the system grows.

The system in certain embodiments is implemented to provide a user withinformation without the need for the user to initiate a request. In thismanner, the system becomes less of a distraction for the user inmultitasking environments that require more of the user's attention,such as in-vehicle environments.

Certain embodiments minimize extra or unnatural steps for accessingspecialty or frequently used information. Accessing information in acomplex data structure can become cumbersome for the user understressful circumstances. For example, instead of taking two steps toaccess a list of stock quotes, in embodiments of the system, the usercan get the desired information by issuing a single command, or nocommand at all.

Since human discourse changes both during conversations and betweenconversations, embodiments of the system are user-specific and can adaptto a user's needs. In other words, the system can be trained to developa personality and structure that serves an individual user better bytracking and monitoring the user's behavior during each interaction. Inaddition, in certain embodiments, the user can train the system bysetting up a user profile to customize the system.

In accordance with one aspect of the invention, a method of providingvoice user interface comprises: providing a voice user interface thatinteracts with a user in a first level of formality; monitoring ahistory of user interaction with the voice user interface; and adjustingthe voice user interface to interact with the user in a second level offormality based on the history of user interaction.

In accordance with another aspect of the invention, a method ofproviding voice user interface services comprises providing a user witha first option to visit one of a plurality of domains by uttering avoice command associated with one of the plurality of domains. Thedomains are contained in an ordered data structure. Each domaincomprises respective content available for presentation to the user. Afirst one of the plurality of domains is visited automatically, if noresponse is provided by the user for the first option. Then the user isprovided with a second option to hear content of the first domain. Thecontent of the first domain is played, if no response is provided by theuser to the second option. In some embodiments, said one or more domainsare visited in an order defined in accordance with user preferenceinformation recorded in a user profile.

Some embodiments of the system further comprise one or more virtualhosts for interacting with a user while the user traverses the ordereddata structure to access the content stored therein. The user has theoption of selecting one or more virtual hosts. Further, the system isimplemented such that said one or more virtual hosts each has a definedpersonality based on the information stored in the user profile. Theuser may update the user profile information to modify the personalitiesof said one or more virtual hosts.

In accordance with yet another aspect of the invention, a voice userinterface system for providing a user with access to content includes anordered data structure having one or more domains. Each domain isassociated with content belonging to one or more content categories. Agrammar is provided for traversing the ordered data structure to accessthe content. The grammar comprises vocabulary having one or more termsassociated with said one or more domains, and rules for visiting saidone or more domains and for playing content therein. The rulescorrespond to said one or more terms.

The system also comprises a user profile having a user preference logfor storing information about a user's preferences for accessing contentin said one or more domains. A user interaction history log storesinformation about the user's history of interaction with the system. Acommand provided by the user at a recognition instance is processedagainst the terms included in the vocabulary for recognition. If a matchis found, then one or more domains in the ordered data structure arevisited or content belonging to said one or more domains is played inaccordance with the rule associated with the command.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1A is a diagram illustrating an environment in which a system ofthe present invention may operate, in accordance with one embodiment.

FIG. 1B is an exemplary illustration of an ordered data structurecontaining a plurality of content domains, in accordance with one aspectof the invention.

FIG. 2 is a method of providing voice user interface services, inaccordance with one or more embodiments of the system.

FIGS. 3A and 3B are block diagrams illustrating exemplary informationthat can be stored in a user profile, in accordance with one embodiment.

FIGS. 4A and 4B are block diagrams illustrating exemplary hardware andsoftware components utilized in one or more system implementations,according to one or more embodiments.

DETAILED DESCRIPTION

Information management systems and corresponding methods, according toone or more embodiments of the invention, facilitate and provideelectronic services for interactive voice systems that dynamically adaptto interact with a user in a natural conversational style.

The terms “electronic services” and “services” are used interchangeablythrough out this description. An online service provider provides theservices of the system, in one or more embodiments. A service provideris an entity that operates and maintains the computing systems andenvironment, such as server system and architectures, which process anddeliver information. Typically, server architecture includes theinfrastructure (e.g., hardware, software, and communication lines) thatoffers the electronic or online services.

These services provided by the service provider may include telephonyand voice services, including plain old telephone service (POTS),digital services, cellular service, wireless service, pager service,voice recognition, and voice user interface. To support the delivery ofservices, service provider may maintain a system for communicating overa suitable communication network, such as, for example, a communicationsnetwork 120 (FIG. 1A). Such communications network allows communicationvia a telecommunications line, such as an analog telephone line, adigital T1 line, a digital T3 line, or an OC3 telephony feed, a cellularor wireless signal, or any other suitable media.

In the following, certain embodiments, aspects, advantages, and novelfeatures of the system and corresponding, methods have been provided. Itis to be understood that not all such advantages may be achieved inaccordance with any one particular embodiment. Thus, the invention maybe embodied or carried out in a manner that achieves or optimizes oneadvantage or group of advantages as taught herein without necessarilyachieving other advantages as may be taught or suggested herein.

Nomenclature

The detailed description that follows is presented largely in terms ofprocesses and symbolic representations of operations performed byconventional computers, including computer components. A computer maycomprise one or more processors or controllers (i.e., microprocessors ormicrocontrollers), input, and output devices, and memory for storinglogic code. The computer may be also equipped with a networkcommunication device suitable for communicating with one or morenetworks.

The execution of logic code (i.e., computer program) by the processorcauses the computer to operate in a specific and predefined manner. Thelogic code may be implemented as one or more modules in the form ofsoftware or hardware components and executed by a processor to performcertain tasks. Thus, a module may comprise, by way of example, ofsoftware components, processes, functions, subroutines, procedures,data, and the like.

The logic code conventionally includes instructions and data stored indata structures resident in one or more memory storage devices. Suchdata structures impose a physical organization upon the collection ofdata bits stored within computer memory. The instructions and data areprogrammed as a sequence of computer-executable codes in the form ofelectrical, magnetic, or optical signals capable of being stored,transferred, or otherwise manipulated by a processor.

It should also be understood that the programs, modules, processes,methods, and the like, described herein are but an exemplaryimplementation and are not related, or limited, to any particularcomputer, apparatus, or computer programming language. Rather, varioustypes of general purpose computing machines or devices may be used withlogic code implemented in accordance with the teachings provided,herein.

System Architecture

Referring now to the drawings, FIG. 1A illustrates an exemplaryenvironment in which the invention according to one embodiment mayoperate. In accordance with one aspect, the environment comprises atleast a server system 130 connected to a communications network 120. Theterms “connected,” “coupled,” or any variant thereof, mean anyconnection or coupling, either direct or indirect, between two or moreelements. The coupling or connection between the elements can bephysical, logical, or a combination thereof.

Communications network 120 may include a public switched telephonenetwork (PSTN) and/or a private system (e.g., cellular system)implemented with a number of switches, wire lines, fiber-optic cables,land-based transmission towers, and/or space-based satellitetransponders. In one embodiment, communications network 120 may includeany other suitable communication system, such as a specialized mobileradio (SMR) system.

As such, communications network 120 may support a variety ofcommunications, including, but not limited to, local telephony, toll(i.e., long distance), and wireless (e.g., analog cellular system,digital cellular system, Personal Communication System (PCS), CellularDigital Packet Data (CDPD), ARDIS, RAM Mobile Data, Metricom Ricochet,paging, and Enhanced Specialized Mobile Radio (ESMR)).

Communications network 120 may utilize various calling protocols (e.g.,Inband, Integrated Services Digital Network (ISDN) and Signaling SystemNo. 7 (SS7) call protocols) and other suitable protocols (e.g., EnhancedThroughput Cellular (ETC), Enhanced Cellular Control (EC2), MNP10,MNP10-EC, Throughput Accelerator (TXCEL), and Mobile Data LinkProtocol). Transmission links between system components may be analog ordigital. Transmission may also include one or more infrared links (e.g.,IRDA).

Communications network 120 may be connected to another network such asthe Internet, in a well-known manner. The Internet connects millions ofcomputers around the world through standard common addressing systemsand communications protocols (e.g., Transmission Control Protocol/Internet Protocol (TCP/IP), HyperText Transport Protocol (HTTP)),creating a vast communications network.

One of ordinary skill in the art will appreciate that communicationsnetwork 120 may advantageously be comprised of one or a combination ofother types of networks without detracting from the scope of theinvention. Communications network 120 can include, for example, LocalArea Networks (LANs), Wide Area Networks (WANs), a private network, apublic network, a value-added network; interactive television networks,wireless data transmission networks, two-way cable networks, satellitenetworks, interactive kiosk networks, and/or any other suitablecommunications network.

Communications network 120, in one or more embodiments, connectscommunication device 110 to server system 130. Communication device 110may be any voice-based communication system that can be used to interactwith server system 130. Communication device 110 can be, for example, awired telephone, a wireless telephone, a smart phone, or a wirelesspersonal digital assistant (PDA). Communication device 110 supportscommunication by a respective user, for example, in the form of speech,voice, or other audible manner capable of exchanging information throughcommunications network 120. Communication device 110 may also supportdual tone multi-frequency (DTMF) signals.

Server system 130 may be associated with one or more content providers.Each content provider can be an entity that operates or maintains aservice through which audible content can be delivered. Content can beany data or information that is audibly presentable to users. Thus,content can include written text (from which speech can be generated),music, voice, and the like, or any combination thereof. Content can bestored in digital form, such as, for example, a text file, an audiofile, etc.

In one or more embodiments of the system; application software 222 isimplemented to execute fully or partially on server system 130 toprovide voice recognition and voice interface services. In someembodiments, application software 222 may comprise a set of modules222(a) and 222(b) that can operate in cooperation with one another,while executing on separate computing systems. For example module 222(a)may execute on communication device 110 and module 222(b) may execute onserver system 130, if application software 222 is implemented to operatein a client-server architecture.

As used herein, the term server computer is to be viewed as designationsof one or more computing systems that include server software forservicing requests submitted by devices or other computing systemsconnected to communications network 120. Server system 130 may operateas a gateway that acts as a separate system to provide voice services.Content may be stored on other devices connected to communicationsnetwork 120. In other embodiments, server system 130 may provide thevoice interface services as well as content requested by a user. Thus,server system 130 may also function to provide content. The terms serveror server software are not to be limiting in any manner.

In some embodiments, a user profile 113 may be stored as user profile113(a) and 113(b), so that it is partially stored on both communicationdevice 110 and server system 130. A separate user profile 113 may beprovided for each user of the system. User profile 113 can be acollection of information that specifies for each user the user'spreferences, history of interaction with the system, and other relevantinformation unique to the user.

In accordance with embodiments of the present invention, the userprofile 113 can be used to implement a voice user interface (VUI, whichdynamically changes in order to emulate a natural conversational style.From the user's perspective, the VUI may seem to become more familiarwith the user over time, either in a single interactive session orthroughout a series of interactive sessions. For example, the VUI can“speak” in a more formal manner with the user, at first, Duringsubsequent interactions, the VUI records in user profile 113 a historyof user interaction with the system. As the user interaction historygrows or develops, the VUI may start to speak in a more informal manner,which simulates a degree of familiarity and intimacy with the user. Thisprovides an enhanced experience for the user.

Application Software for Providing Voice User Interface

Referring to FIGS. 1 and 2, application software 222, in accordance withone aspect of the invention, is executed on server system 130 to providea voice user interface (VUI) between a user using communication device110 and a content provider attached to network 120. Providing a VUIinvolves a method 200 for receiving, processing, and responding to voicerequests submitted via communication device 110 in a series of exemplarysteps illustrated in FIG. 2.

A user, typically, uses communication device 110 to access contentavailable from a content provider, which can operate server system 130,for example. According to one or more embodiments, a user at step 210logs into the system. At the login stage, the VUI prompts the user toprovide a user personal identification number (PIN). The PIN can be afour-digit number or combination of letters and numbers, for example. Atstep 220, the system receives the user PIN, repeats it for verificationand attempts to authenticate it against confidential records stored onthe system.

If the login is successful, the system greets the user by his or hername for example. In one embodiment, if authentication fails, the systemallows the user to try again (e.g., three tries) to enter a valid PIN.An exemplary VUI login session is provided below:

-   -   VUI: Welcome. Please tell me your personal identification        number.    -   User: 1234    -   VUI: 1234, is that correct?    -   User: Yes.    -   VUI: Good Afternoon John.

Once the user has successfully logged in, the system attempts to locatethe user's profile 113, at step 230. At step 240, if the system does notfind user profile 113, then at step 245 the system determines whether auser profile needs to be created. If, for example, it is the user'sfirst interactive session, then no profile for the user may beavailable. Thus, at step 255, the VUI may provide the user with theoption and opportunity to input profile information into the system. Inone or more embodiments, profile information is received by the systemby way of user interaction with the VUI, or a graphic user interface(GUI) available on a web site, or other interactive interface.

The user can interact with such interface to create the profile, oralternatively if the profile already exists, to update the profile. Atstep 250, the user can select to update his or her profile. Once theprofile is updated or created, then at step 260 the system processes theprofile information and incorporates it into the system for the userpreferences to take effect. After processing the user profile at step260, in accordance with one aspect of the invention, the systemperiodically monitors and analyzes the content of the user profile,specifically user interaction history 330. Based on the informationstored in user profile 113, the system at step 265 adjusts theconversational style in accordance with the natural rules of socialdiscourse. The VUI waits for a user request at step 270.

Based on user interaction history 330 the system can distinguish anovice user from an expert user. Thus, conversational style, menus, andother interface features are automatically adjusted based on the user'sexperience level, so that the user would have the impression ofinteracting with a human rather than a machine. For example, aconversational style may become less formal as discourse continues in asingle session, or as a user interaction history develops during thecourse of multiple sessions. Other possible adjustments to theconversational style are possible and will be discussed in furtherdetail below.

One or more embodiments include a feature that allows users to accesscontent in the available domains in accordance with their presetprofiles without having to interact as much with the system during asession. So at step 275, the system automatically visits the firstunvisited domain or category in the ordered data structure, if no userrequest is received at step 270. Once a domain, sub-domain, or categoryis visited, the system plays or otherwise presents the correspondingcontent, unless interrupted or otherwise directed by the user.

In some embodiments, the VUI may provide the user with a greeting and/ora prompt, respectively at steps 277 and 279, prior to playing thecontent. If a user request is received, at step 285, the system grantsthe request, if possible, by visiting the requested content domain, atstep 280. If no user request is received, the system then moves on tovisit the next unvisited domain in the ordered data structure, at step290, in accordance with the user profile. At step 295, the systemdetermines if the user has requested to log out. If so, method 200terminates. Otherwise, the system returns to step 260 to further processuser profile, for example.

VUI Domains:

The system, in accordance with one embodiment, has one or more primarycontent domains, and possibly sub-domains, defined by an ordered datastructure, for example. A commonly used ordered data structure 100 forstoring data in an organized manner is illustrated in FIG. 1B. Thisstructure includes a main menu for access to one or more primary domainsor sub-domains thereof. A content domain represents a group ofinformation that is accessible by the user through the VUI. Informationin each domain can be related to a common topic or subject. Exemplarydomains may include Mail, Stock Quotes, Weather, News, Sports Scores,and Entertainment. In some embodiments, the News domain has sub-domainsfor World, Local, and Business, for example, and the Entertainmentdomain has, for example, the following sub-domains: Horoscopes, TVGuide, and Lottery Results.

In accordance with one aspect of the invention, the sub-domains for eachdomain may be implemented using various data structures. In someembodiments, the sub-domains may be in the form of a profile listincluding a list of information categories under the associated domain.The News domain, for example, includes profile lists for the sub-domainsof World, Local, Business, etc. In other embodiments, the sub-domainsmay be implemented separately from and linked to the associated domain:For example, sub-domains of Horoscope, TV Guide, and Lottery areprovided apart from the associated domain of Entertainment domain.

To access the data in each domain or sub-domain, the user interacts withthe system using specific voice commands. Each of these domains may haveone or more sub-domains. In order to access the content of eachsub-domain a user may be required to move through the associated domainfirst. For example, in the exemplary embodiment illustrated in FIG. 1B,if the user is in the News domain, the user may readily move to thebusiness sub-domain to listen to business related news. However, if theuser is visiting the Entertainment domain, the user may have to visitthe “Horoscope” and the “TV Guide” sub-domains before accessing the“Lottery” domain for information relating to lotteries. Data structuresother than data structure 100 may also be utilized for organizingcontent in an accessible manner.

VUI Grammar:

User requests (i.e., voice commands) need to meet certain requirements.For example, a request should be recognizable by the VUI before it canbe acted on by the system. To be recognized, at least part of therequest or command needs to be included in a vocabulary for a grammar ofthe system. The vocabulary may comprise a set of terms or phrases, forexample. In a voice recognition system for implementing at least a partof the VUI, a separate acoustic model may be provided for each term orphrase of the vocabulary. Once the user provides a command, the systemdetermines whether that command is part of the vocabulary. That is, thesystem attempts to recognize the command. If the command is recognized,the system may take some predefined action in response to the recognizedcommand, such as, for example, visiting a particular domain.

Voice recognition accuracy suffers as the number of terms in thegrammar's vocabulary increases, because the system needs to process alarger vocabulary. Also, chances of improper recognition increase, ifthe vocabulary includes multiple acoustically similar terms that havedistinct meanings. Therefore, it is more efficient and accurate for thesystem to be implemented so that only a limited number of terms areprocessed and recognized at each instance. We refer to these instancesas recognition instances, throughout this document

As provided in further detail below, in some embodiments, a particulargroup of commands are recognizable by the VUI at all times (i.e.,globally), regardless of the domain visited. This group of commands canbe referred to as a “global vocabulary” in that these commands areavailable by default at all recognition instances. Other commands,however, even if included in system's vocabulary, are recognizable onlywhen the user is visiting a certain domain. This limitation inrecognition improves both system efficiency and accuracy.

Exemplary commands that may be globally recognizable, in accordance withone or more embodiments include: “Next,” “Previous,” “First,” “Last,” orequivalents thereof (e.g., “forward,” “back,” “get the first One,” “getthe last one,” “go to”). Using such commands, a user can direct thesystem to visit domains in the immediate vicinity of the currentlyvisited domain, for example. The following is an exemplary dialoguebetween a user and the VUI, while the user is accessing informationavailable in the Mail domain. In the exemplary dialogues providedherein, “TTS” indicates a portion of the dialogue wherein the system mayuse text-to-speech software/hardware to “vocalize” written text.

-   -   VUI: You have three new messages and you have old messages.        Here's the first one.    -   Message from: (TTS) Bill Byrne, Subject: (TTS) hello . . . Say        PLAY IT to hear the rest of the message.    -   User: Get the next one.    -   VUI: Next one. Message from: (TTS) Sam Jones, Subject: (TTS)        meeting.    -   User: Get the last one.    -   VUI: Last one. Message from: (TTS) Sally Smith, Subject: (TTS)        lunch.    -   User: Get the previous one.    -   VUI: I'll go back one, Message from: (TTS) Sam Jones, Subject:        (TTS) meeting.    -   User: Get the first one.    -   VUI: Here's the first one. Message from: (TTS) Bill Byrne,        Subject: (TTS) hello.

In some embodiments, the VUI will go on to the next item automaticallyif the user remains silent, as provided in the following example:

-   -   User: Get the next one.    -   VUI: Next one. Message from: (TTS) Sam Jones, Subject: (TTS)        meeting.    -   User: (Silence)    -   VUI: Here is the next one: (TTS) Hi Bill . . . (end of header).

In the following, other exemplary terms and commands that may beincluded in the system's global vocabulary are provided. It should benoted that the following terms or commands are provided by way ofexample. Alternative vocabulary or synonyms for these commands can beused, if desired.

“Pause,” “Stop,” “Take a Break”

Users may need to discontinue interacting with the VUI in order toattend to other matters, for example, to talk to someone else, or simplyto pay attention to something urgent. By using the “pause” command, theuser can prevent the system from processing user dialogue forrecognition for a certain timeout period (e.g., for up to three minutes)or indefinitely, depending on implementation or user customization. Tocontinue interacting with the system prior to the expiration of thetimeout period, the user may have to reactivate the system by issuing areactivation command, such as, “come back,” “continue,” “return,” orequivalents thereof. Once the system is reactivated, it provides theuser with a message providing information about the previous recognitioninstance, and or the last domain visited, for example. The following isan exemplary demonstration of how the dialogue may transpire:

-   -   User: Take a break.    -   VUI: Sure. Say “come back” when you need me.    -   User: (talks to a friend in the passenger seat—VUI does not        respond).    -   User: Come back.    -   VUI: You were at the Mail domain before. Continue with playing        message from Bill Byrne?

“Goodbye”

In accordance with one aspect of the system, users may choose to end aVUI session by saying “Goodbye,” or other termination command, forexample. Because the system may interpret an acoustically similarutterance as a termination command, to lower frustration levels in suchcircumstance, the system waits for a timeout period (e.g., threeseconds) before terminating the session. During the timeout period, theuser has a chance to reinstate the session. The session may bereinstated if the VUI detects the user uttering a specific command, oranything, for example. An exemplary termination dialogue is providedbelow:

-   -   User: Get my sports scores.    -   VUI: OK. Talk to you later.    -   User: No! Wait!    -   VUI: Would you like to go back to where we left off?    -   User: Yes!    -   VUI: OK. We were at the Mail domain before . . .

“Help”

In one or more embodiments, invoking the “Help” command will deliver theappropriate response based on the location of the user in the dialog.Other phrases or terms equivalent to the term “Help” may be utilized.For example, a user may say, “What are my choices?” or “Choices” to getthe VUI to provide him or her with a list of domains or sub-domainsavailable for visiting at the particular instance, An exemplary dialoguethat may ensue while the user is visiting the News or the Sports domainis provided below:

-   -   (Visiting in the News domain)    -   User: What are my choices?    -   VUI: You can say Headline News, Business News, National News,        World News, Sports News, or Stock Market Update . . .    -   (Visiting in the Sports domain)    -   User: What are my choices?    -   VUI: To move through the list in your profile say Get the first        one, Get the next one, Get the previous one, Get the last one.        Otherwise tell me the sports category you'd like me to look up.        For college sports say College Football, etc . . .

It is noteworthy to point out that the grammar in various domains may beimplemented differently. For example, as provided in the above examples,in the News domain, the grammar may include vocabulary associated withthe titles of the domains or sub-domains, while in the Sports domain,the grammar may comprise the global vocabulary.

This change in interaction styles or modes between the domains, not onlyprovides for better recognition accuracy and efficiency, but alsodelineates between the domains by providing a different interactiveexperience. The grammar vocabulary and rapes may be expanded or limitedin other manners to provide a user with a comfortable and smoothinteractive experience, as provided herein.

“Go back”

In accordance with one or more embodiments of the, system, the “Go back”command causes the system to return to a previous domain, such as thepreviously visited domain. An exemplary dialogue using this command isprovided below:

-   -   VUI: Let's check your email . . .    -   User: Go back.    -   VUI: I'll go back to your Sports Scores.

“Move on”

In accordance with one or more embodiments of the system, the “Move on”command causes the system to visit the next unvisited domain in theordered data structure, or the next domain in the order specified inuser profile 113. In some embodiments, if there are no more unvisiteddomains, the VUI will prompt the user to make a choice. An exemplarydialogue is provided below:

-   -   User: Move on.    -   VUI: Moving to Stock Quotes . . .

Or

-   -   User: Move on.    -   VUI: There are no more new domains to visit. To move on say “Get        my email,” “Get my stock quotes,”. . .

“Forget it,” “Cancel”

In accordance with one or more embodiments of the system, the “Forgetit” or the “Cancel” command causes the system to move to a neutraldomain in the dialogue and ask the user for the next action to be taken.For example, in one embodiment, if there are unvisited domains, the VUIwill give the user a chance to say something and then simply move on tothe next specified domain. An exemplary dialogue is provided below:

-   -   VUI: Here's the next mail item . . .    -   User: Forget it.    -   VUI: No problem. Let me know what you'd like me to do next.        Otherwise I'll just move on.

“Customer care”

In accordance with one or more embodiments of the system, the “Customercare” command telephonically connects the user to the service provider'scustomer care facilities. In some embodiments, to limit an improperrecognition of this command, the VUI prompts the user to confirm theselection, as provided below:

-   -   User: Get me customer care.    -   VUI: Connecting to customer care. Is that right?    -   User: Yes.    -   VUI: OK. Dialing.

User Profile:

A user profile 113, in accordance with one embodiment, is a collectionof information that includes the user's preferences, interactionhistory, and other relevant information that is unique to each user.FIGS. 3A and 3B illustrate exemplary information that can be a part ofthe user profile, in accordance with an embodiment. Such information mayinclude, but is not limited to, user preference 310 and user interactionhistory 330. As depicted, user preferences 310 can include informationfor personalization 312, menu design 313, interface history features316, and personality 320. User interaction history 330 can includeinformation for interaction period 331, interaction sequence 332,interaction date 333, interaction path 334, and interaction errors 335.User preferences 310 and user interaction history 330 are described inmore detail herein. Customized profiles for each individual user can bestored on server system 130, communication device 110, or other systemsconnected to communications network 120.

User Preferences

User preferences 310 may include one or more of the following categoriesof information, depending on implementation or user preference, forexample:

Personalization

Referring to FIG. 3A, a user may have certain interface preferences 310.For example, in certain embodiments, the VUI may be customized based onpersonalization information 312 to traverse the ordered data structure100 in a unique path as defined by each user (FIG. 1B). That is, a usercan customize his or her profile to define the content domains,sub-domains, and/or categories that the user prefers to visit, the orderin which the user prefers to visit the various content. Personalizationinformation 312 may also define a user's favorite domains, sub-domains,or categories that the user prefers to access immediately without havingto go through the hierarchy in ordered data structure 100. For example,referring to FIG. 1B, a user may customize his or her profile to includethe domains Mail, News, and Entertainment so that the VUI would play thecontent included in the above domains in the following order: News,Mail, Entertainment.

In some embodiments, the user may customize the personalizationinformation 312 such that content included in certain sub-domains isaccessible from the main menu. For example, referring to the exemplaryordered data structure 100, a user may want to be able to access lotteryinformation from the main menu or any other domain or sub-domain withouttraversing through the ordered data structure's 100 hierarchy. Thus, theuser may set up his or her respective profile so that the globalvocabulary would include the terms associated with the lotterysub-domain. In this manner, the VUI will recognize a user request foraccessing lottery information at any recognition instance.

In some embodiments, the system records information about the contentrequested or sub-domains accessed most frequently by a specific user.Once a threshold is reached, or a condition is met, for example, thenthe system automatically adds the terms associated with a correspondingdomain to the global vocabulary. As such, the system automaticallyexpands its grammar to recognize various requests for themost-frequently accessed content.

Menu Design

In embodiments of the system, the VUI includes menus that adjust basedon familiarity of the user with the system. For example, in oneembodiment, the user can provide menu design information 313 tocustomize system menus to his or her preference. For example, the usermay have the choice of selecting between extended or shortened menus. Anextended menu provides a user with most or all the available options ateach recognition instance. A shortened menu provides the user with asubset of the available options, unless the user requests otherwise. Insome embodiments, the length of prompts for each menu option isadjusted, as well. This technique helps to reduce occasional frustrationassociated with listening to lengthy menus or instructions that a moreexperienced user may have no interest in.

In one embodiment, if the user has customized the user profile for theshortened menu option, the menu setting may be switched to extended menuoption if the user provides a specific command, such as, “Switch toextended menu.” The difference between the options provided in anextended menu versus a shortened menu depends on implementation and mayvary based on user preference. Provided below are exemplary promptsprovided at the main level, when a user first logs in:

-   -   (Extended Menu)    -   VUI: Good morning John. Please select from the following        domains:

Menu, Stock Quotes, News, Weather, Sports, Entertainment . . . ”

-   -   User: Get my Stock Quotes.    -   (Shortened Menu)    -   VUI: Hi John. Which domain do you want to visit?    -   User: Stock Quotes.

In certain embodiments, the system is implemented to include a barge-infeature. This feature allows the user to interrupt the system before theentire prompt has been played. That is, if the VUI, while playing aprompt, detects a user utterance, then the VUI attempts to recognizedthe utterance and service the request immediately. This feature, alsohelps to reduce user frustration associated with using automatedsystems.

In one or more embodiments, the system automatically adjusts menu lengthbased on the nature and extent of user interaction with the system. As auser continues to interact with the system, the user learns more aboutthe availability of the domains, the paths leading to a certain domain,and the various commands available for accessing different types ofcontents. For a novice user, however, traversing the system may be a bitof a challenge until the user becomes familiar with the system'sintricacies. Thus, in some embodiments, the system monitors and recordsa user's interaction history 330 with the system, as illustrated in FIG.3B, and uses that information to adapt the system menu to the needs ofthe user.

Interface Features

In accordance with one aspect of the invention, first-time users willhear a brief (e.g., two or three minute) tutorial that will outline theoverall structure of the VUI domains, menus, and major features. Inaddition, the tutorial defines various commands and directs users to anaffiliate web site, for example, for further information and assistance.Since the tutorial instruction may be too long or too detailed forretention, the system provides the users with the chance to review orreplay the tutorial during subsequent sessions by, for example, saying“Play the tutorial.”

The style of natural discourse, typically, changes as the parties get toknow one another better. Thus, in one embodiment of the system, the VUIwill adjust its behavior according to the rules of natural discourse.For example, when a first-time user interacts with the VUI, the VUI mayaddress the user in a more formal or polite manner, provide him withmore assistance by offering extended menus, and play a first voiceprompt that is recorded such that the speaker speaks in a slow pace. Incontrast, in subsequent interactions, the VUI may provide a more casualdialogue, limit any extraneous interaction instructions, and play asecond voice prompt such that the speaker speaks in a faster pace, forexample. The following dialogues demonstrate how a first-time user mayexperience a different interactive session in comparison with along-term user:

-   -   (First-time user)    -   User: Get my Sports Scores.    -   VUI: Moving to Sports Scores. For a list of available        categories, say “What are my choices?” There are five sports        categories in your sports profile. Here's the first one. <VUI        plays audio feed> . . .    -   (Long-term user)    -   User: Get my Sports Scores.    -   VUI: Moving to Sports Scores. Which Category?    -   User: Major League Baseball.    -   VUI: OK. <VUI plays audio feed for Major League Baseball>.

In one or more embodiments, if the user remains quiet, the VUI will readthrough the user profile to determine the user's preference at thatpoint, if available. The VUI will then attempt to visit the appropriatedomains, sub-domains, and deliver content automatically rather thanwaiting for user instructions. For example, in one embodiment, thedefault behavior for the VUI is to move on to domains unvisited by theuser. In some embodiments, the system moves on: (1) after the user hasheard the last item in a category, or (2) after the user has timed outby failing to respond to a VUI prompt. The following dialogues providean illustration of VUI interaction with a user in an exemplaryembodiment:

-   -   User: Get my Sports Scores.    -   VUI: Moving to Sports Scores. You've listed one category. Here        it is <VUI plays audio feed>.    -   VUI: That was the only item in your sports profile.    -   User: (Silence)    -   VUI: Let's move on to Business News (next unvisited category        specified in the User profile).

Or

-   -   User: Get my Sports Scores.    -   VUI: Moving to Sports Scores. Tell me the sports category you'd        like me to look up.    -   User: Look up Professional Basketball.    -   VUI: <VUI plays feed for that category>    -   User: (Silence)    -   VUI: Let me know what you'd like me to do. Otherwise, I'll just        move on.    -   User: (Silence)    -   VUI: Let's move on to Entertainment (next unvisited category in        the ordered data structure.

In some embodiments, if the VUI has gone through all categories listedin the user profile, the VUI then prompts the user to make a choice, asprovided below, for example:

-   -   VUI: That was the last category listed in your profile. Let me        know what you'd like me to do. If you need help say, “What are        my choices.”

In summary, the VUI processes information included in the user profileand waits for a user request. One or more embodiments include a featurethat allows users to access content without having to interact with thesystem during a session. The system visits the first unvisited domain orcategory in accordance with the personalization information 312, forexample. The system monitors the visited domains, sub-domains, andcategories by, for example, tagging each one after they have beenvisited.

Once a domain, sub-domain, or category is visited, the system plays thecorresponding content, unless otherwise interrupted or directed by theuser. In some embodiments, the VUI may provide the user with a greetingand/or a prompt, prior to playing the content. If a user request isreceived, the system grants the request, if possible, by visiting therequested content domain. If no user request is received, the systemthen moves on to visit the next unvisited domain in the ordered datastructure in accordance with the user profile.

Interface Personality

In consideration of the fact that personality is a significant aspect ofspoken discourse, embodiments of the system are implemented so that auser can select one or more virtual hosts with different personalities.Referring to FIG. 3A, a user is able to indicate in his or her profilespecific character traits such as tone 321, sex 322, accent 323,formality 324, speed 325, character 326, and background 327 to develop apersonality for the VUI host.

The result of the personality development process is a back-story ormini-biography of the host with whom the user will interact. In someembodiments, the back-story is thorough enough to capture specifictraits. For example, the back-story would provide how formal, humorous,helpful, eager, or businesslike the host may act. With this informationavailable, the system maintains consistency throughout the VUI levelsand makes decisions about prompt wording and the structure and frequencyof help prompts, for example. While a user has the choice of selectingfrom different virtual hosts, once a virtual host is selected the userwill be interacting with the selected host who will maintain aconsistent personality, unless otherwise changed by the user.

In one embodiment, the system may allow the user to select from a numberof different personalities. A first personality, Mary for example ishelpful, articulate, confident, and takes initiative. A secondpersonality, Jim for example is authoritative, formal, self assured, andserious. A third personality, Tom for example is young, friendly, andcasual. Other characters and personalities may be developed based on thepersonality information 320 provided in the user profile.

User Interaction History

Referring to FIG. 313, the interaction history 330 may comprise thefollowing information: interaction period 331, interaction sequence 332,interaction date 333, interaction path 334, and interaction errors 335.Interaction period 331 denotes, for example, the length of interactionduring each interactive session. Interaction sequence 332 denotes, forexample, the frequency with which the user accesses the system over aperiod of time. The system uses this information to determine the user'sexperience level in interacting with the system.

Using the above factors, the system can automatically adjust the systemconfiguration or even user preferences 310 to better suit the user'sneeds. For example, if the interaction period 331 or interactionsequence 332 indicate that the user has a long history of interactionwith the VUI, then the system adjusts the VUI prompts to includeconversational styles that are less formal, or the system adjusts theVUI's menus from extended mode to shortened mode.

In one embodiment, the system monitors user interaction with the VUIover time, for example, during the course of a single session, or duringthe course of multiple interactive sessions. This information isrecorded in user profile 113 and is periodically updated as userinteraction with the VUI continues. The system determines the userinteraction level based on information recorded in user profile 113 asuser interaction history develops. In some embodiments, for example,interaction period 331 or interaction sequence 332 are associated withvalues that are incremented based on the amount of time a user spendsinteracting with the VUI, or the number of times the user has interactedwith the VUI, over a certain time span.

The system evaluates the user interaction level with the VUI based onthe above values and accordingly adjusts system settings. For example,the VUI may address the user by his last name if user interaction levelhas not reached a certain threshold (e.g., the user has interacted withthe system in less than three sessions, or under three minutes). Oncethe threshold is met, the system may then address the user by his firstname, for example, or otherwise adjust the VUI prompts and menus so thatfrom the User's perspective a more casual interaction ambiance isprovided.

In some embodiments, the system may ask for the user's permission beforeadjusting the conversational style to a more casual level, for example,to avoid the possibility of offending the user. Further, a user mayactively set the conversational style and various interactive featuresby manually adjusting the values and information recorded in the userprofile. As provided earlier, in one or more embodiments, a user mayinteract with the VUI, or a graphic user interface (GUI), for example,to initially create a user profile 113, or alternatively if the profilealready exists, to update the information included in user profile 113.Once the profile is updated or created, the system processes the profileinformation and configures the system accordingly for the userpreferences to take effect.

It is noteworthy that the information recorded as part of userinteraction history 330 may be utilized to adjust system features otherthan those provided herein. Further, other system features may beadjusted based on information gathered and recorded during eachinteractive session. Thus, the examples provided here are by way ofexample and therefore are not to be construed as limiting the scope ofthe invention.

Interaction date 333 denotes, for example, the date and time of userinteraction with the system. Interaction path 334 denotes, for example,a history of visited domains within the ordered data structure.Interaction errors 335 comprise, for example, a list of the user's mostcommon interaction errors or all such errors. The above information isused by the system to adjust system features so that a user can morecomfortably and efficiently access the available content.

For example, the system may use the interaction date to determine if auser has not interacted with the system in a long period. If so, thesystem may greet the user by indicating how nice it is to hear from himagain, or advise the user of any newly implemented features since theuser's last session. If the user has had a long history of interactionwith the VUI, the system may provide the user with extended menus torefresh the memory of the user and then switch back to the shortenedmenu mode again, once a threshold is reached.

Information recorded as part of interaction path 334 and interactionerrors 335 are useful in implementing the system's grammar so that theuser is better understood and directed towards the appropriate contentincluded in various domains of ordered data structure 100. For example,certain most frequently visited domains, sub-domains, or categories maybe added to a globally accessible grammar, so that the content of suchdomains or sub-domains is immediately accessible, or automaticallyprovided to the user, as soon as the user logs in.

For example, if the recorded interaction history indicates that the userchecks information related to the weather conditions for San Franciscoevery time the user logs in, then the system may adjust the grammar sothat the user would not have to visit the Weather domain first in orderto get San Francisco weather. Alternatively, the VUI may ask the user atthe beginning of each session the following question:

-   -   VUI: Good morning John, would you like to know what the weather        is like in San Francisco today?    -   User: Yes.

Or, the system may provide the information voluntarily, if theinteraction history indicates that the first content the user accessesat each session is the weather information for San Francisco. Anexemplary system prompt in such situation is provided below:

-   -   VUI: Good morning John, the weather forecast for San Francisco        is sunny, humid, . . . What can I get for you, today?

Interaction errors 335 are recorded in user profile 113 to monitor thetypes of errors that occur during user interaction with the system. Forexample, if the system detects that in many recognition instances noinput is provided, that may indicate that the VUI is too sensitive anddetects extraneous noise in the user's environment as input. In suchsituation, the system may automatically adjust the VUI sensitivity levelso that any detected sound with a level that is less than apredetermined threshold is discarded and not processed as input meantfor recognition.

Also, in accordance with one aspect of the system, if a certain acousticmodel is repeatedly not recognized by the VUI, then the system mayprocess the repeated acoustic model to determine the nature of the userutterance. If the system determines that the utterance is improperlyrejected, for example because the system lacks a sufficient variety ofacoustic models, then the system adds the new acoustic model to thegrammar's vocabulary. As such, the system can be customized for eachindividual user so that user-specific commands are recognized by the VUIand performed by the system.

For example, consider the following exemplary dialogue between a userand the VUI, in accordance with one embodiment:

-   -   VUI: You have 3 new mail messages.    -   User: Read the first one.    -   VUI: I'm sorry, I didn't understand that. To read your first        message say get me the first mail message.    -   User: Get the first one.    -   VUI: I am sorry, I didn't get that either. To read your first        message say get me the first mail message.

In the above example, acoustically different commands are used torequest the performance of the same action, In one or more embodiments,the system adapts to the user's preferred command set by monitoringconsistent rejection patterns. In some embodiments, the system alsodetermines if any rejection is due to the user's accent or tone ofvoice. To resolve this problem additional acoustic models are added tothe grammar's vocabulary that match user utterances with heavy orunusual accents, for example.

Embodiments of the invention are described by way of example asapplicable to systems and corresponding methods that provide an adaptiveand natural voice interface system. In this exemplary embodiment, logiccode for performing these methods is implemented in the form of, forexample, application software 222. The logic code, in one embodiment,may be comprised of one or more modules that execute on one or moreprocessors in a distributed or non-distributed communication model.

Hardware & Software Environments

In accordance with one or more embodiments, the system is composed oftwo environments, a software environment and a hardware environment. Thehardware includes the machinery and equipment that provide an executionenvironment for the software. On the other hand, the software providesthe execution instructions for the hardware.

The software can be divided into two major classes including systemsoftware and application software. System software includes controlprograms, such as the operating system (OS) and information managementsystems that instruct the hardware how to function and processinformation. Application software is a program that performs a specifictask. As provided herein, in embodiments of the invention, system andapplication software are implemented and executed on one or morehardware environments.

The invention may be practiced either individually or in combinationwith suitable hardware or software architectures or environments. Forexample, referring to FIG. 1A, communication device 110 and serversystem 130 may be implemented in association with computing system 410(FIG. 4A). Application software 222 for providing an adaptive VUI may beimplemented in association with one or multiple modules as a part ofsoftware system 420 (FIG. 4B). It may prove advantageous to construct aspecialized apparatus to execute said modules by way of dedicatedcomputer systems with hard-wired logic code stored in non-volatilememory, such as, by way of example, read-only memory (ROM).

Hardware Environment

An embodiment of the system can be implemented as application software222 in the form of computer readable code executed on a general purposecomputing system 410. Computing system 410 includes a central processorunit (CPU) 401, a main memory 402, an input/output controller 403,optional cache memory 404, user interface devices 405 (e.g., keyboard,pointing device), storage media 406 (e.g., hard drive), a display screen407, and a communication interface 408 (e.g., an integrated servicesdigital network (ISDN) card). A communication bus 400 is utilized toconnect the above system components. Computing system 410 may be capableof communicating with other systems through communication interface 408.

In one or more embodiments, computing system 410 may not include all theabove components, or may include additional components for additionalfunctionality or utility. For example, computing system 410 can be alaptop computer or other portable computing device that can sendmessages and receive data through communication interface 408. Computingsystem 410 may be partially or fully embodied in an embedded system suchas a set-top box, a personal data assistant (PDA), a wirelesscommunication unit (e.g., cellular phone), web televisions, or othersimilar hardware platforms that have information processing and/or datastorage capabilities.

Communication interface 408 can send and receive electrical,electromagnetic, or optical signals that carry digital data streamsrepresenting various types of information including logic code. Thelogic code can be executed by central processor unit 401 or is stored instorage media 406 or other non-volatile storage for later execution.Logic code may be transmitted via a carrier wave or may be embodied inany other form of computer program product. In one or more embodimentsof the invention, processor 401 is a microprocessor manufactured byMotorola, Intel, or Sun Microsystems Corporations. The named processorsare for the purpose of example only. Any other suitable microprocessor,microcontroller, or microcomputer may be utilized.

Software Environment

FIG. 4B illustrates exemplary computer software 420 suited for managingand directing the operation of the hardware environment described above.Computer software 420 is, typically, stored in storage media 406 and isloaded into memory 402 prior to execution. Computer software 420 maycomprise system software 421 and application software 222. Systemsoftware 421 includes control software such as an operating system thatcontrols the low-level operations of computing system 410. In one ormore embodiments of the invention, the operating system can be MicrosoftWindows 2000®, Microsoft Windows NT®, Macintosh OS®, UNIX, LINUX, or anyother suitable operating system.

Application software 222 can include one or more computer programs thatare executed on top of system software 421 after being loaded fromstorage media 406 into memory 402. In a client-server architecture,application software 222 may include a client software 222(a) and/or aserver software 222(b). Referring to FIG. 1A for example, in oneembodiment of the invention, client software 222(a) is executed oncommunication device 110 and server software 222(b) is executed onserver system 130. Computer software 420 may also include web browsersoftware 423 for browsing the Internet. Further, computer software 420includes a user interface 424 for receiving user commands and data anddelivering content or prompts to a user.

Exemplary Embodiment of Voice User Interface System

Embodiments of the invention are described by way of example asapplicable to a system and corresponding methods that provide anadaptive voice user interface.

Provided below are the descriptions of the content accessible in eachdomain and exemplary dialogues for traversing through some of thesedomains.

Mail

The mail domain allows a user to listen and delete voice messages storedon the system for the user. Once deleted, messages are sent to a trashbin, which cannot be accessed via the VUI. In accordance to oneembodiment, users are presented first with the mail header. Thereafter,a user may cause the system to play the body of the message by saying,for example, “Play it,” or other equivalent command or instruction. Todelete the message the user may say, for example, “Get rid of it,” orother equivalent command or instruction. An exemplary dialogue isprovided below:

-   -   User: Get my mail.    -   VUI: You have three new messages and you have old messages.        Here's the first one.    -   Message from: (TTS) Bill Byrne, Subject: (TTS) hello . . . Say        “Play it” to hear the rest of the message . . .    -   User: Play it.    -   VUI: (TTS) Hi Bill.    -   User: Get rid of it.    -   VUI: Are you sure you want to delete this message?    -   User: Yes.    -   VUI: OK, it's gone.    -   User: Get the next one . . .

In one or more embodiments, after a message is read, it will be taggedas “old,” but is not deleted until the user specifically instructs thesystem. Old messages are not accessible, in some embodiments, until thenext time the user logs into the system. An exemplary list of commandsand instructions available while visiting the Mail domain are providedbelow:

-   -   Get my new mail    -   Get my old mail    -   Get my mail    -   Get rid of it/Throw it away    -   Play it/Read it    -   Play it again/Read it again    -   Get the first one    -   Get the next one    -   Get the previous one    -   Get the last one

Stock Quotes

The Stock Quotes domain allows users to listen to information about apredefined list of stocks in accordance with the content of the userprofile. In some embodiments, the user can also cause the system to lookup any publicly traded company or index, for example. Exemplarydialogues within the Stock Quotes domain are provided below:

-   -   User: Get my stock quotes.    -   VUI: Moving to stock quotes. You have three companies listed.        Here's the first one . . . General Magic . . .    -   User: Look up a quote for IBM.    -   VUI: IBM . . . Last sale price . . .    -   User: Look up the NASDAQ.    -   VUI: The NASDAQ is up 30 points at 3999.

In accordance with one embodiment, stock quotes are delivered asconcatenated prompts. Concatenated prompts are sound bytes that are putnext to each other and played, in order to form an audio output. In someembodiments, the user can cause the system to repeat the information forthe stocks listed in the user profile by simply repeating “Get my stockquotes” or “Get my stock profile.” An exemplary dialogue is providedbelow:

-   -   User: Look up a quote for IBM.    -   VUI: IBM . . . Last sale price . . .    -   User: Get my stock quotes.    -   VUI: I'll get your profile . . . You've listed . . .

An exemplary list of commands and instructions available while visitingthe Stock Quotes domain are provide below:

-   -   Get my stock quotes    -   Look up a quote for <company name>    -   Play it again/Read it again    -   Get the first one    -   Get the next one    -   Get the previous one    -   Get the last one

News

The News domain allows users to listen to a predefined list of newscategories as defined in the user profile. It also allows the user tolook up news stories in a specific new category or a specific new story,for example. In some embodiments, the set of news categories availablein the News domain is limited to ten to twenty choices. News stories ineach category are in the form of prerecorded audio feeds and similar toa radio broadcast. Thus, the broadcasting voice can change from story tostory.

Exemplary dialogues within the News domain are provided below:

-   -   User: Get my news.    -   VUI: Moving to News . . . You've listed three categories in your        news profile Here's the first one . . . <Play audio feed>.    -   User: Get my news.    -   VUI: Here is your business news update for July 15th at 3:00        p.m. eastern . . .    -   User: Look up Sports News.    -   VUI: Here is your sports news update for July 15th at 3:00 p.m.        eastern . . .    -   User: Look up World News.    -   VUI: This is the World News Update for . . .    -   User: Get my news.    -   VUI: I'll get your profile . . . You've listed . . .

An exemplary list of commands and instructions available while visitingthe News domain are provide below:

-   -   Get my news    -   Play/Read it again    -   Get the first one    -   Get the next one    -   Get the previous one    -   Get the last one    -   Headline news    -   National News    -   World News    -   Business News    -   Sports News    -   Stock Market Update

Sports Scores

The Sports Scores domain allows users to listen to scores for currentsport events as indicated in the predefined list included in the userprofile. The user can also look up the scores for sport events notlisted in the user profile by providing specific commands to access thatinformation. This information is provided in the form of audio feeds, inaccordance to one aspect of the invention. Exemplary dialogues withinthe Sports Scores domain are provided below:

-   -   User: Get my Sports Scores.    -   VUI: Moving to sports scores . . . You've listed three        categories in your sports profile. Here's the first one . . .    -   Here is your San Francisco Giants update . . .    -   User: Look up Pro Football.    -   VUI: Here is NFL update for July 15th at 3:00 pm eastern . . .    -   User: Look up College Basketball.    -   VUI: Here's your Men's NCAA Basketball update for . . .    -   User: Get my sports scores.    -   VUI: I'll get your profile . . . You've listed . . .

An exemplary list of commands and instructions available while visitingthe Sports Scores domain are provide below:

-   -   Get my sports scores    -   Major League Baseball    -   Professional hockey    -   Professional basketball    -   Professional golf    -   Speedway racing    -   College sports update    -   College basketball    -   College football    -   Play it again    -   Get the first/next/previous/last one

Weather

The Weather domain allows users to listen to weather reports for a listof cities included in the user profile, for example. Alternatively, auser may access weather information by providing the zip code of a city,or other identifying information. In some embodiments, the system cantrack the user's geographic coordinates, via a Global Positioning System(GPS) or based on cellular site locations, for example, and provide theuser with the local weather forecast.

Weather reports are delivered in the form of concatenated prompts andcan comprise weather watches, warnings and advisories, wind chill, windspeed, heat index, and humidity readings, for example. Other informationin the report can comprise current temperature and conditions, as wellas the day's forecast, and high and low temperatures. In someembodiments a five-day forecast is also provided. Exemplary dialogueswithin the weather domain are provided below:

-   -   User: Get my weather.    -   VUI: Moving to weather You've listed three geographic locations        in your weather profile. Here's the first one (city name in TTS)        Columbus, Ohio—There's a tornado warning in your area. Currently        . . . it's 80 degrees and very windy with winds at 30 knots out        of the southwest. Today's forecast calls for clear skies, with a        high of 84 and low of 69 . . .    -   User: Look up my local weather.    -   VUI: <TTS City name> Your local weather station reports . . .

Exemplary commands available in the Weather domain are:

-   -   Get my weather    -   Look up the local weather    -   Play/Read it again    -   Get the first one    -   Get the next one    -   Get the previous one    -   Get the last one

Entertainment

Referring to FIG. 1B, in one or more embodiments, the Entertainmentdomain comprises three sub-domains: Horoscopes, Television Guide, andLottery. Each user can setup an Entertainment profile and choosecategories within the above sub-domains that include audio feedscorresponding to each category of information. In embodiments of theinvention, the sub-domains are implemented such that the user can accesscontent of a single sub-domain without having to listen to the contentof the other sub-domains, for example.

Exemplary dialogues in the Entertainment domain are provided below:

-   -   User: Get my entertainment profile.    -   VUI: Moving to entertainment . . . You have seven items listed        in your entertainment profile. Here's the first one. The winning        Big Game numbers are . . .    -   User: Get the next one.    -   VUI: Here's the next one. Aquarius, today you will . . .    -   User: [silent]    -   VUI: Here's the next one. Ally McBeal meets a man who . . .    -   User: [silent]    -   VUI: Here's the next one. Yesterday, on Day's of Our Lives . . .    -   User: [silent]    -   VUI: Here's the next one. On ABC tonight at 6:00 . . .    -   User: Get the last one.    -   VUI: Here's the last one. On FOX at 6:00 . . .    -   VUI: Let me know what you'd like me to do.    -   User: Get my TV guide.    -   VUI: You have four television items in your entertainment        profile. Here's the—    -   User: Look up the Young and the Restless.    -   VUI: The Young and the Restless . . .    -   VUI: Let me know what you'd like me to do.    -   User: Get my news.    -   VUI: Moving to news. You have three items listed in your news        profile . . .    -   User: Get my lottery results.    -   VUI: OK. Moving to lottery results. You have one item listed in        your lottery profile. Here's the first one. The winning Big Game        numbers are . . .    -   User: Goodbye.    -   VUI: Thanks for calling. Bye.

(Another Example)

-   -   User: Get my horoscopes.    -   VUI: You have two horoscopes listed in your entertainment        profile.        Here's the first one . . .    -   User: Get my sports scores.    -   VUI: Moving to sports scores . . .    -   User: Get my entertainment.    -   VUI: Moving to entertainment. You have 6 categories listed in        your entertainment profile.    -   User: Get my horoscopes.    -   VUI: Moving to horoscopes. Tell me the horoscope you'd like me        to look up, otherwise, I'll just read your horoscopes again. For        a list of signs, say “What are my choices?    -   User: Look up the horoscope for Virgo.    -   VUI: Today is your day, Virgo.    -   User: Get my horoscope profile.    -   VUI: You have two horoscopes listed in your entertainment        profile.        Here's the first one . . .    -   User: Get my lottery results.    -   VUI: You have two lotteries listed in your entertainment        profile. Here's the first one. Here is the result of the . . .

In accordance with one aspect of the system, the user while in theEntertainment domain can lookup the lottery results by state (e.g.,“Lookup the Lottery for California.”), television programs by category(e.g., “Lookup Soap Operas.”), and horoscopes by astrological sign(e.g., “Lookup the Horoscope for Virgo.”). Lottery, for example, can bealso looked up by name (e.g., Pick 3, California Fantasy). Exemplarydialogues in the Lottery sub-domain are provided below:

-   -   User: Get my lottery results.    -   VUI: Moving to lottery results. You have six lotteries listed in        your entertainment profile. Here's the . . .    -   User: Look up the California state lottery.    -   VUI: I have seven lottery results for that state. Here's the        first one: California Daily 3, winning numbers are . . .    -   User: Get the next one.    -   VUI: Next one. California Daily Derby winning numbers for        Tuesday . . .    -   User: (silent)    -   VUI: Here's the next one. Here are the California Fantasy        results for . . .    -   User: Get the next one.    -   VUI: Next one. Here is the result of the California Super Lotto        . . .    -   User: Get the last one.    -   VUI: Here's the last one. The results of the California . . .

The TV Guide sub-domain may include multiple categories, for example:Series Update, Soap Opera Diary, and Evening Line-Up. The titles ofthese categories may of course be selected differently, or additionalcategories may be included, depending on implementation. Series Updateprovides a synopsis of what happened on the major evening series, whileSoap Opera Diary gives an overview of happenings from the daily soaps.The difference between these two categories is that soap operas changedaily, while prime time television series typically air once a week andare often reruns. Evening Line-Up provides a list of shows and the showtimes for each network. Each category if selected returns a list offeeds that the user may then browse through to hear the desired feeds.Exemplary dialogs in the TV guide sub-domain are provided below:

-   -   User: Get my television guide.    -   VUI: Moving to television. You have six television items listed        in your entertainment profile. Here's the . . .    -   User: Look up Soap Opera Diary.    -   VUI: I have ten Soap Operas. Here's the first one. On General        Hospital, Jake . . .    -   User: Get the next one.    -   VUI: Here's the next one. Yesterday, on Day's of Our Lives . . .    -   User: (silent)    -   VUI: Here's the next one. The Bold and the Beautiful . . .    -   User: Get the last one.    -   VUI: Here's the last one. Guiding Light . . .    -   User: Look up Series Update.    -   VUI: I have nine items in Series Update. Here's the first one.        On Ally McBeal . . .    -   User: Get the next one.    -   VUI: Here's the next one. The X-files . . .    -   User: Get the last one.    -   VUI: Here's the last one. NYPD Blue . . .    -   User: Look up Evening Line-up.    -   VUI: I have eight items in Evening Line-up. Here's the first        one. On ABC tonight . . .    -   User: Get the last one.    -   VUI: Here's the last one. On ESPN tonight . . .

Listed below are exemplary commands and instruction users are to use inorder to switch from one domain to the next:

-   -   Get my email    -   Get my stock quotes    -   Get my news    -   Get my weather    -   Get my sports scores    -   Get my entertainment    -   Get my horoscopes    -   Get my television guide    -   Get my lottery results

Thus, methods and systems for providing a voice user interface areprovided. The embodiments described above are to be considered in allaspects as illustrative only and not restrictive in any manner. Thus,other exemplary embodiments, system architectures, platforms,implementations, and applications that can support various aspects ofthe invention may be utilized without departing from the essentialcharacteristics described herein. These and various other adaptationsand combinations of features of the embodiments disclosed are within thescope of the invention. The invention is defined by the claims and theirfull scope of equivalents.

1.-55. (canceled)
 56. A method comprising: receiving a request forcontent corresponding to a domain of a voice interface; determiningwhether the request satisfies a request threshold made to the domain;and adding terms associated with the domain to a global vocabulary forthe voice interface based on satisfaction of the request threshold. 57.The method of claim 56, further comprising: receiving a personalizationrequest comprising configuration information for the voice interface.58. The method of claim 57, wherein adding the terms is further based onthe personalization request.
 59. The method of claim 57, furthercomprising: configuring one or more favorite domains of the voiceinterface based on the personalization request.
 60. The method of claim57, further comprising: configuring a traversal path for one or moredomains of the voice interface based on the personalization request. 61.The method of claim 56, further comprising: storing the request in aninteraction history portion of a profile; and adjusting a conversationalstyle of the voice interface based on the interaction history.
 62. Themethod of claim 56, further comprising: storing the global vocabulary ina profile.
 63. A computer-readable medium having instructions storedthereon, execution of which, by a computing device, causes the computingdevice to perform operations comprising: receiving a request for contentcorresponding to a domain of a voice interface; determining whether therequest satisfies a request threshold made to the domain; and addingterms associated with the domain to a global vocabulary for the voiceinterface based on satisfaction of the request threshold.
 64. Thecomputer-readable medium of claim 63, the operations further comprising:receiving a personalization request comprising configuration informationfor the voice interface.
 65. The computer-readable medium of claim 64,wherein adding the terms is further based on the personalizationrequest.
 66. The computer-readable medium of claim 64, the operationsfurther comprising: configuring one or more favorite domains of thevoice interface based on the personalization request.
 67. Thecomputer-readable medium of claim 64, the operations further comprising:configuring a traversal path for one or more domains of the voiceinterface based on the personalization request.
 68. Thecomputer-readable medium of claim 63, the operations further comprising:storing the request in an interaction history portion of a profile; andadjusting a conversational style of the voice interface based on theinteraction history.
 69. The computer-readable medium of claim 63, theoperations further comprising: storing the global vocabulary in aprofile.
 70. A system comprising: a memory storing: a receiving moduleconfigured to receive a request for content corresponding to a domain ofa voice interface, a determining module configured to determine whetherthe request satisfies a request threshold made to the domain, and anadding module configured to add terms associated with the domain to aglobal vocabulary for the voice interface based on satisfaction of therequest threshold; and one or more processors configured to process themodules.
 71. The system of claim 70, further comprising: apersonalization module configured to receive a personalization requestcomprising configuration information for the voice interface.
 72. Thesystem of claim 71, wherein adding the terms is further based on thepersonalization request.
 73. The system of claim 71, wherein thepersonalization module is further configured to configure one or morefavorite domains of the voice interface based on the personalizationrequest.
 74. The system of claim 71, wherein the personalization moduleis farther configured to configure a traversal path for one or moredomains of the voice interface based on the personalization request. 75.The system of claim 70, further comprising: a storing module configuredto store the request in an interaction history portion of a profile; andan adjusting module configured to adjust a conversational style of thevoice interface based on the interaction history.
 76. The system ofclaim 70, further comprising: a storing module configured to store theglobal vocabulary in a profile.